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Abstract 

We define a class of "algebraic" random matrix channels for which one can generically compute 
the limiting Shannon transform using numerical techniques and often enumerate the low SNR series 
expansion coefficients in closed form. We describe this class, the coefficient enumeration techniques and 
compare theory with simulations. 
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The analytic computability of the Shannon 
transform for a large class of random matrix 

channels 



I. The Shannon transform 

Consider a multiple input, multiple output (MIMO) communication system with Nr receive antennas 
and Nt transmit antennas where the A^^ x 1 received vector y is modelled as 

y = Hx + z. (1) 

In ([TJ, H is an Nj- x Nt sized random matrix whose (i,j)-th entry is the complex valued propagation 
coefficient between the i-th receive antenna and j-th transmit antenna. The transmitted signal is denoted 
by the A'^t x 1 vector x while the Nr x 1 vector z is the additive noise at the receiver. We assume that 
z is zero mean, circularly symmetric complex Gaussian noise with independent, equal variance real and 
imaginary parts and that, without loss of generality, E[xx^] = I where E[.] denotes the expectation of 
the (random) quantity in the brackets. The transmitted vector x is subject to the power constraint P so 
that TrE[xx^] < P. 

When the MIMO channel matrix is a random matrix, i.e., its elements are random variables, then it 
is common to transmit complex valued circularly symmetric signals x so that E[xx^] = {P/Nt)I. The 
ergodic capacity of the MIMO system [1], assuming the receiver has perfect knowledge of the realization 
of H, is then given by 



C{P) := Eh 



logdet(I + ^HH') 



(2) 



where ' denotes the conjugate transpose and the expectation is with respect to the probability distribution 
of the random channel matrix H. Equation (O can be rewritten in terms of the eigenvalues of (l/A'"t)HH' 
as 

C{P)=NtV{P) (3) 
where V{P) is the Shannon transform [2] of the matrix {l/Nt)'H'H.' defined as 

V(7) :=EA[log(l+7A)], (4) 
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and the expectation is with respect to the probabiUty distribution of a randomly selected (with uniform 
probability) eigenvalue of (l/A^t)HH'. From ^ and (01) it is evident that one can seek to analytically 
characterize the Shannon transform of those MIMO random matrix channels for which the eigenvalues 
of (l/A^t)HH' can be analytically characterized. In general, except for the special cases when Nt = I ot 
Nr = 1, the "exact" analytical expressions for Shannon transform found in the literature [1], [3]-[5] are 
really determinental formulae. In other words, the Shannon transform is expressed as a determinant of a 
matrix for which there are closed form expressions for the individual elements. The reader is directed to 
[6] for some representative formulae and a summary of random matrix channels for which exact closed 
form expressions are available. 

The existence of the determinental representation for the Shannon transform is a fundamental truism 
even in the simplest case when there is i.i.d. Rayleigh fading between the transmitter and receiver 
antenna elements [1]. A limitation of these results is that the determinental end results makes it is hard 
for practitioners to gain engineering insight on how the parameters such as SNR, Nr and Nt affect 
the ergodic capacity (Shannon transform). More importantly, the range of random matrix channels for 
which the eigenvalues of {l/Nt)^.!!' can be characterized exactly for finite Nr,Nt is very restrictive 
and invariably limited to matrices with (complex) Gaussian entries. 

A. The limiting Shannon transform 

This has motivated the investigation into the properties of the limiting Shannon transform V(7) instead 
which is defined as 

V(7) = Voo(7) := lip V(7) for Nr/Nt ^ c G (0, oo). (5) 

Let the empirical distribution function (e.d.f.) of an arbitrary N x N matrix Aj^ with real eigenvalues 
be defined as 

A , , Number of eigenvalues of Am < x 
F^" (x) = ^ . (6) 

If the (random) e.d.f of W := (1/A^()HH' converges, for every x, almost surely (or in probability) as 
Nt,Nr{Nt) ^ oo to a non-random distribution function F^{x), then the limiting Shannon transform, 
when the limit exists, can be written as 

Vwil) = J log(l + ^X)dF'^iX). (7) 
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The limiting Shannon transform, for small values of 7, can be expressed as the series 

Vw{l) = / E ^-^^I'X'dF^iX) = Y: ^^^Mf (8) 

k=l k=l^ ^ ' 

where := f X^dF^{X) is the A;-th moment of the limiting probability distribution function . 

The main contribution of this correspondence, which relies on the results in [7], [8], is the identification 
of a broad class of random matrix channels for which the limiting Shannon transform in Q can be 
numerically computed and for which the coefficients of the series expansion in ([8]l can be efficiently 
enumerated, often in closed form. Examples found in the literature [1], [9]-[12] which rely on results 
from infinite/large random matrix theory are but special cases of this broader class of algebraic random 
matrix channels, which we define next. We leave it to practitioners to justify the physical relevance of 
more complicated random matrix models built using the framework presented. 

II. The CLASS OF algebraic MIMO channels 

Definition 1 (Algebraic random matrix [7], [8]): Let F^(x) denote the limiting eigenvalue distribu- 
tion function of a sequence of random matrices Wjv- If a bivariate polynomial 

i=0 j=0 

with > 0, > and real-valued coefficients aij exists such that the Stieltjes transform of F^ (x) 
defined as 

mw{z) = [ ^—dF^{x) for z £ C+ \R, (9) 
J X - z 

is algebraic, i.e., it is a solution of the equation L^^{m\^{z), z) = then W^v is said to be an algebraic 
random matrix. The density function fy/ = dF^ is referred to as an algebraic density and we say that 
fw S Paig and Wjv € A^aig, the class of algebraic probability densities and random matrices respectively. 

Definition 2 (Algebraic MIMO random matrix channel): Let H be an Nr x Nt sized random matrix 
MIMO channel. If Wat^ := (l/iVt)HH' is an algebraic random matrix for Nt, Nr{Nt) 00 and Nr/Nt 
c > then H is said to be an algebraic MIMO random matrix channel and we say that H G Haig, the 
class of algebraic MIMO channels. 

In [7], [13], we describe the generators of the class of algebraic random matrices as well as procedures 
for computing the bivariate polynomial that encodes the limiting eigenvalue distribution. We focus 
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on the sub-class of random matrix channels that are generated from Gaussian distributed entries in what 
follows. We direct the reader to [7], [13] for additional examples. 

Theorem 2.1 ( [7], [8]): Assume that G is an Nr x Nt sized MIMO random matrix channel with i.i.d. 
CJ\f{0, 1) distributed elements and that A and B are appropriately sized non-negative definite algebraic 
random matrices independent of G. Then for all s > 0, the MIMO random matrix channels 

• Doubly correlated channel model: H = A^/^GB^/^ 

• Random Rician-Uke fading model: H = A^/^ + s G 

are algebraic as well in the sense of Definition [2] 

Theorem 12.11 provides the building block for analyzing the properties of a much broader classes of 
random matrices than what is found in the literature. The starting point for applying Theorem 12.11 is the 
bivariate polynomial representations L^^^ and L^^. In [7], [13] we describe the mapping L^^, Lj^^ i-^ 
and implement it in the form of a MATLABbased random matrix calculator which can be downloaded 
from [14]. In particular, the commands corrWish (LmzA, LmzB, c) and AgramWish (LmzA, c, s) 
implement the mapping L^^, L^^ i-^ for the random matrix transformations in Theorem 12. II 

To make the ideas presented more concrete we consider some simple random matrix channels and list 
the corresponding bivariate polynomial encoding. For the channel H = A^^, W = {l/Nt)'H.tl' = I so 
that the Stieltjes transform of = I(l,oo)(a^)^ defined as in can be shown to satisfy the equation 

L^(m, z) = where 

L-(m,z)=m(l-z)-l. 

The Rayleigh fading channel considered in [1] is algebraic by applying Theorem 12.11 with A = Itv,, and 
B = ItVj . It can be shown that 

L^(m, z) = czm^ — (1 — c — z)m+l (10) 

The doubly correlated Gaussian random matrix falls into the setting described in Theorem 12.11 The 
situation where matrices A and B are the covariances of an AR(1) process with coefficient a is considered 
in [12] and is yet another example of an algebraic random matrix channel. Here we have 

z) = L^^{m, z) = [z^ - 2 z^a + z) + {2 z"^ - Aa z + 2) m + z - 2 a 

and 

L^(m, z) = -z^m^c^+{2 z^c - 2 z^ac - A z'^c^) m^+{2 z^a - z^ - z - 5 zc^ - 6 z'^ac + 6 cz) n? 

+ (-6 azc^Aaz-2-2z^-2(? + Ac)m-2ac-z^2a 
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Consider the situation when the matrices A and B have Umiting eigenvalue distribution 

F^{x) = = 0.5I[i,^) + 0.5I[2,oo) 

so that their Stieltjes transform satisfies the equation L^^{m, z) = = L^^{ni, z) where 

L^^{m, z) = L^^im, z) = {-6 z + 2 z^ + 4) m + 2 z - 3. 
Then the random matrix channel A^/^GB^/^ is algebraic and we have 



(11) 



where: 



L 



^ = V V [T' 

j=l k=l 



C 



Jjk 



^z^ \ 



64 



(13) 



-18c+18c2 18c- 9 4 

-108c2 + 36c+72c3 -112 c + 18 + 130 -18 + 54 c 4 

64 c^ + 64 c'' - 128 c^ 72 c - 324 c^ + 288 c^ 224c2-112c 36 c 

64 c^ - 256 c^ + 192 c^ 360 c^- 216 c^ 112 c^ 

192 c^- 128 c^ 144 c3 



We leave it to the reader to verify that the examples considered in [9]-[ll] are special cases of algebraic 
random matrix channels as well. 



(12) 



A. Computation of the Shannon transform and its low SNR series expansion 

Once we have L^, we can obtain the limiting eigenvalue distribution by a simple root-finding algorithm 
as described in [7], [13], isolating the correct branch of the solutions, taking its imaginary part and 
scaling by l/vr. This is motivated by the fact that the probability distribution can be recovered from 
its Stieltjes transform by using the Stieltjes inversion formula [15] 



1 



dF (x) = — lim Im (2; + ^0 • 



(14) 



vr 5^0+ 

In the examples considered above, except for the simplest case corresponding to i.i.d. Rayleigh fading. 
Dm > 4 so that we have to resort to numerical techniques to obtain dF^ (x) and compute the Shannon 
transform using ([7]). The development of efficient numerical code that extracts the correct branch of the 
Stieltjes transform from the Dm solutions of the equation LJ^(?ti, z) = so that ([T4l ) may be applied to 
yield the limiting eigenalue distribution remains an open problem. Hence, the remarkable fact [7], [13] 
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that for algebraic random matrix channels it will generically be possible to obtain the coefficients of the 
low SNR series expansion in (HJl in closed form assumes greater importance as far as lending engineering 
insight when dealing with complicated (algebraic) MIMO channel models. 

We note that the A;-th coefficient of the Shannon transform series expansion in ([8]) is given by 
= {—l)''^^M^/k. The algebraicity of the limiting eigenvalue distribution allows us to efficiently 
enumerate the limiting moments in closed form. To do so, we first define the ordinary) moment generating 
function fiw{z) := 1 + J^i^i ^'^'i •^^'^^ ^^^t can be obtained from the Stieltjes transform mw{z) 
by applying the transformation 

^^w{z) = -mw{l/z). (15) 

z 

Thus, given the bivariate polynomial LjJ^(m, z) we can obtain the algebraic equation L}^^{^, z) satisfied 
by nwiz) by applying the transformation 

and clearing the denominator. The Maple based package gfun [16] can be used to obtain the series 
expansion for fiw{z) up to degree expansion_degree directly from the bivariate polynomial L^^ by 
using the commands: 

> with (gfun) : 

> MomentSeries = algeqtoseries (Lmyuz , z , myu, expansion_degree, ' pos_slopes ' ) ; 

For the i.i.d. Rayleigh fading channel whose limiting eigenvalue distribution is encoded by the bivariate 
polynomial ( fTOl ). the corresponding moment generating series is given by 

/x^y = 1 + z + (1 + c)z'^ + (1 + 3c + c^)z^ + (1 + 6c + + c^)/ + 0{z^) (16) 

For the doubly correlated Rayleigh fading channel whose limiting eigenvalue distribution is encoded by 
the bivariate polynomial (fT2l) . the corresponding moment generating series is given by 

9 /45 45\ y /675 243 . 243\ , 

uw(z) = l + -z+ — cH hz + c H H z'^ 

^ 4 V 8 8 J V 16 16 16 y 

/3555 2 1377 o 3555 1377\ . ^ , 

+ H H c H ] z^ + (z^) . (17) 

V 16 32 16 32 y \ I ^ ' 

III. Numerical simulations 

Figure [T] plots the mean empirical Shannon transform V(7) for various values of 7 (SNR) for the 
i.i.d. (uncorrected) Rayleigh fading channel and the doubly correlated Rayleigh fading channel with the 



February 2, 2008 



DRAFT 



THE ANALYTIC COMPUTABILITY OF THE SHANNON TRANSFORM FOR A LARGE CLASS OF RANDOM MATRIX CHANNELS? 




0.001 0.002 0.003 0.004 0.005 0.006 0.007 0.008 0.009 0.01 



Fig. 1: The mean Shannon transform versus 7 averaged over 20000 trials for A^^ = 50, Nt = 200. 



(a) Li.d. Rayleigh fading. 



Nr 


Nt 


c 


Pi 


1^1 = 1 


1^2 


1^2 = -(l + c)/2 




1^3 = (l + 3c + c2)/3 


50 


200 


0.25 


1.0000 


1.0000 


-0.6250 


-0.6250 


0.5989 


0.6042 


50 


100 


0.50 


1.0001 


1.0000 


-0.7502 


-0.7500 


0.9070 


0.9167 


50 


50 


1 


1.0003 


1.0000 


-1.0004 


-1.0000 


1.6430 


1.6667 


50 


26 


1.923 


0.9998 


1.0000 


-1.4609 


-1.4615 


3.4145 


3.4892 



(b) Doubly correlated Rayleigh fading where the matrices A and B have limiting e.d.f given by dl lb . 



Nr 


Nt 


c 


Pi 


= 9/4 


P2 


-2 = -(i-+Ti) 


P3 


/'675 „ 1 243 „2 , 243\ 


50 


200 


0.25 


2.2500 


2.2500 


-3.5153 


-3.5156 


8.6956 


8.8945 


50 


100 


0.5 


2.2502 


2.2500 


-4.2189 


-4.2188 


12.9866 


13.3594 


50 


50 


1 


2.2509 


2.2500 


-5.6276 


-5.6250 


23.2916 


24.1875 


50 


26 


1.923 


2.2494 


2.2500 


-8.2139 


-8.2212 


48.0846 


50.8280 



TABLE I: Comparison of theoretical in dS) with estimates from numerical simulations 



limiting eigenvalue distributions of A and B given by (ITTI ). The Table |(b)| compares the coefficients 
of the series expansion obtained from the empirical data with the theoretical predictions. The excellent 
agreement confirms the utility of the closed form expansions and the well document fact [2]that the 
Nr, Nt —>■ 00 limiting answer is a good approximation of the Nr, Nt finite result. 
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